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The Florida Teacher Certification* Examination (FTCE) 
is based upon selected competencies that have been identified; as 
minimal entry-level skills for prospective teachers. A description is 
given of the four subtests which make up the FTCE: (1) writingr-essay 
on general topics; (2) reading — multiple choice "cloze" procedure on 
general education passages derived from textbooks, journals, and 
state publications; (3) mathematics — multiple choice questions on 
basic mathematics, simple computation, and "real world" problems; and 
(4) professional education — multiple choice questions on general . 
' education (personal, social, academic development, administrative 
skills, and exceptional student education). This technical report 
provides information on the test's creation and .assembly, 
administrative procedures, and scoring and reporting. A table 
presents statistics on the number and percent of students ( 1990-8-1) 
passing all subtests, by education major or program. The psychometric 
characteristics of validity, reliability, item discrimination, and 
contrasting group performance of the FTCE are discussed. Appendices 
provide information on: (1) essential competencies and subskills 
tested; (2) mathematical illustrations of formulas; (3) security and 
quality control procedures; and (4) scoring the writing examination. 
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INTRODUCTION 



Background 



Each applicant for an initial Florida teacher's certificate oust pass the 
Florida Teacher Certification Examination "(FTCE) . The FTCE was established by 
Sectton 321.17, Florida Statutes, and is administered by the Florida Department of 
Education. 

The competencies that form the basis for the Florida Teacher Certification 
Examination were identified through a study conducted by the Council on Teacher 
Education (COTE). 1 As a result of the study, twenty-three Essential Generic 
Competencies were established upon which to base the Examination and to form a 
part of the curricular requirements at Florida colleges and universities with 
approved teacher education programs. Later legislative action combined two of 
the competencies, numbers six and nineteen, and created an additional competency 
dealing with education for exceptional students. 

An ad hoc task force convened by the Department of Education developed 
subs kills for the identified competencies. The subskills were reviewed and 
critiqued by* various individuals and organizations including, a random sample of 
certified education personnel, statewide professional teacher organizations, and 
all colleges and universities with approved teacher education programs. The 
twenty-three Essential Generic Competencies and the subskills are* listed in 

appendix A. . / . 

» 

Test item specifications were written for each subskill. Specifications 
are rules and parameters for writing test items to measure a particular 
aubskill. They provide Information such as the length of the stimuli, the mode 
of the stimuli (graph, problem situation, mathematical algorithms), the 
characteristics of the stem (question, statement completion), the 
characteristics of the correct answer, and the characteristics of the foils. 
The specif ications also include detailed information about the content upon 
which the tests are based. The complete specifications are contained in the 
Florida Teacher Certification Examination Bulletin II: The G eneral Education t 
Subtests — Reading, Writing, Mathematics and in the Florida Teacher agl 
Certification Examination Bulletin III? "The Professional Edu cation SubY»t. 
Copies are available from the Department for a nominal fee. 

Passing scones for each subtest were recommended by a panel of Judges, all of 
whom were either current or past members of COTE and who had been involved in 
the development of the Examination. The panel was made up of classroom 



1 CbTE was a statutory advisory council appointed by the State Board of 
Education to advise tne Commissioner of Education on all matters dealing with 
teacher education and certification. COTE was replaced by the Florida Education 
Standards Commission in 1980. 



teachers, school administrators, teacher educators, and community representa- 
tives* Passing score recommendations for each subtest were made to the 
Commissioner of Education. These recommendations were adopted as a rule by the 
State Board of Education on July 30, 1980. 

The operational tasks of preparing teat forms, administering the tests t and 
scoring the answer sheets are completed through an external contract* The 
contract' for these tasks was awarded to the University of Florida Office of 
Instructional Resources for the three administrations of the 1980-81 school 
year* 

Periodically, ~o*tfacts are Issued for the development of additional test 
items* New items are needed to maintain a large pool of high quality and secure 
test items. A large item pool makes it possible to develop alternate forms of 
the test so that aft* examinee who retakes a subtest will receive a new set of 
questions. 

/ , 'v item development is subject to the restrictions of the item 
specie at ions. Test development contractors must provide intensive item 
reviews and conduct pilot tests of the items. Following this, the Department 
invites a panel of college and university educators to review the new Item"* 
This review consists of a critical reading of each item for possible bias, 
adequate subject content, and adequate technical quality. After the new items 
have been thoroughly reviewed and revised they are field-tested by imbedding 
them in a regular test form and administering them to a sample of examinees. 
The item difficulties are calibrated with latent trait techniques and equated to 
existing items. Later forms of the FTCE contain the new items. 



Description of the Examination 

The FTCE is administered three times a year at sites throughout Florida. 
The test takes an entire Saturday to complete. Examinees usually receive their 
results within one month. Examinees who fall any part of the FTCE may retake 
that portion at a subsequent administration. The FTCE is a written test 
composed of four subtests. The characteristics of the four subtests are 
summarized i** Table 1. 



TABLE 1 



A Description of the Four Subtests 
of the 

Florins Teacher Certification Examination 



Subtest 



Writing 



Competency 
Tested 



Reading 



Mathematics 



Professional 6, 7, 9-18, 
Education 20-24 



Type of 
Question 

Essay, writing 
production 



Multiple choice 
"cloze" proce- 
dure 



Multiple choice 



Multiple choice 
(problem solving 
application 
level) s 



Content 



General topics 



General educa- 
tion passages 
derived from 
textbooks. Jour- 
nals, state 
publications 

Saslc mathematics: 
simple computa- 
tion and "real 
world" problems 

General education 
(personal, social, 
academic develop- 
ment, administra- 
tive skills, excep- 
tional student 
education) 



Scoring 

Holistic 
scoring by 
trained 
experts 

Objective 



Objective 



Objective 



The Writing Subtest is scored hollstically ("general impression marking") by 
three trained judges. The scoring criteria include an assessment of the 
following: 

1. Using language appropriate to the topic and reader 

2. Applying basic mechanics of writing 

3. Applying appropriate sentence structure 

4. Applying basic techniques of organization 

5. Applying standard English usage 

6. Focus log on the topic 

7. Developing ideas and covering the topic 

More detailed information on FTCE administrations is contained in the 
Florida Teacher Certification Examination Registration Bulletin. This booklet 



is available tree from Florida school district offices and frooi the Department 
of Education. 

Four bulletins have -been developed to provide information about the FTCE * 
The subtest and item^ specifications have been published In Bulletin I: ^ 
Overview , Bulletin II; The General Education Subtests — Reading, Writing, 
Mathematics, and Bulletin Hit The Professional Education Subtest . Bulletin 
IV: The Technical Manual describes the technical adequacy of the examination. 
The first three bulletins were distributed to all Florida teajcher education 
institutions and school system personnel offices in the fall of 1979. Bulletin 
IV, designed primarily for measurement professionals, was published in 1981. An 
overview of the coverage of the FTCE is provided in Appendix C of Bulletin IV » 



Rasch Calibration of Items 

Calibration of items is conducted using Rasch methodology and the BICAL 
computer program. The Rasch model bases the probability of a particular score 
on two parameters, the person's ability and the Item's difficulty. The model is 
expressed as: 

P U vl 1 B v ,5 i ) - exp U vi <B y - 6^] / [1 + exp (B y - 6^ J 



in which X . =* a score 
vi 

B >= person ability 
v 

6, - item dif f icul ty 
1 

Estimat^ of person ability and item difficulty are obtained using maximum 
likelihood estimation as described in Wright* Mead, and Bell ( BICAL: 
Callbiating It ems with the Rasch Model , 1980). , 

J 

The process of obtaining item difficulties for new items involves field 
testing experimental items within regularly administered test~forms. Multiple 
forms for each administration are comprised of sets of scored items in each form 
and different sets of experimental items* A subset of the scored items forms a 
common link between forms* The new Items are calibrated to the same scale as 
the regular Items • All items are then linked to the base scale of November 1980 
by a linking constant. This linking constant is the difference between the 
average calibration values for the common items in November 1980 and their mean 
difficulty in the current administration. A description of this process can he 
found in Ryan ( Item Banking » 1980). 

Following each administrat ion, the data are randomly divided into three 
setF >{ 700 candidates each. Candidates are assigned in sequential order to the 
appropriate data set. Calibrations are conducted on the data of the Candida te^ 
in each set and the mean difficulty values across the data are calculated for * 
each item. r 



TEST COMPOSITION, ADMINISTRATIdN . ■ aH^ SCORING 

Test Creaklon and Assembly 

The it*** contained in the Department of Ration item bank are * a " b ™"d 
and equated to the base scale established durlnFthe April 1980 field test. The 
items are given identification codes^and detailed information on the item usage 
is maintained including the identification of fche form on which each item was 
used^the difficulty value, item point-bi serial correlation, and Rasch fit 
statistics for each item. 

Each test form is designed to ensure that the items (a) tit the item 
specifications for the skill that they were designed to measure, (b) conform to 
the test specifications in number and type, and (c) represent a range of 
difficulty with a mean difficulty approximating zero logits. 

A test blueprint is prepared for each form. Items are selected and 
subjected to content, style, and statistical reviews by the Office of 
Instructional Resources at the University of Florida and the Florida Department 
of Education. Test items are screened for content overlap. 

Placement of the items on the test is primarily a function of appearance 
and content. The order of the items is not related to their difficulty. Items 
are grouped together if they are similar In editorial style, directions* and 
question stems. 

Experimental items are field-tested within each subtest but are not counted 
in a candidate's score. When multiple test forms are used, the core of regular 
(scored) items in each form remains the same for any administration. Test forms 
are spiral td so that each test center receives approximately the samd number of 
each fi*m. In this way, all experimental items are field-tested by £ least 400 
candidates who represent a cross-section of the people who take the Examination. 

Once the form has been approved, the scoring key Is verified. Staff 
members from the Department of Education, the Office of Instructional Resources, 
and three teachers from the public schools take the Examination. These persons 
are also asked to identify any ambiguous items or confusing directions. 

Camera-ready copy is prepared by a test specialist and a graphic artist. 
Attention is paid to the proper placement of items to provide workspace where 
necessary. The camera-ready copy is again critiqued by the staff "the 
Department of Education and Che Office of Instructional Resources- Corrections 
are made, the copy Is sent to the printer, and a final check of the proofs 
made before the tests are printed. 
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Administration Procedures 

Examination dates, times, and locations 

?he FTCE ia administered in the fall,' winter, and summer of each yeir.N 
Administration dates for 1980-81 were November 22, 1980; April 4, 1981; and 
August 22, 1981. Candidates were permitted to take all four subtests or any 
subtest previously not passed. Eight locations in the state were designated as 
testing areas. Specific ^ites within each area were selected as test centers. 
These centers were selected from the pool of established centers for the 
administration of standardized examinations. Designated test locations for the 
1980-81 administrations were: 

i 

s 

1.. Pensacola 

2. Tallahassee 

3. Gainesville 

4. Jacksonville 

5. St. Petersburg 
t> . Tampa 

7. Sarabota 

8. «Miami 



All teat centers were inspected to ensure that the rooms met the required 
specifications for lighting, seating capacity^ storage facilities, air 
conditioning, and protection from outside disturbances. All facilities were 
able to accommodate handicapped candidates. 



The test schedule Is divided into morning and afternoon sessions. Testing 
time is fixed, but allows adequate time for candidates to complete all sections 
of -the Examination. Candidates may continue to the Reading Subtest after they 
finish the Mathematics section. The schedule for each subtest Is listed belov: 



Waiting 
Mathematics 
Reading 
Break 

Professional 
Education 



45 mLfrutes 
70 minutes 
50 iinutes 
'Wlninures 

150 minutes 



9:00 a.m. - 9:45 a.m. 
10:00 a.m. - 11:10 a.m. 
11:10 a.m. - 12:00 noon 
12:00 noon - 1:00 p.m. 

1:30 p.m. - 4:00 p.m. 



A sttcurity plan has been developed and implemented for the program. 
Appendix C for further information about security and quality control. 



Refer to 



Special arrangements are made as necessary for handit apped candidates. A 
Braille version of the Examination is available. Typewriters or a flexible time 
schedule is permitted for handicapped candidates. 
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Test manuals 

t Uniform testing procedures were established for use at all centers 
throughout the state. Documentation of the procedures* is available in the Test 
Administration Manual for the program. The administration manual includes the 
following topics: 

1. Duties of the Test Center Personnel 

2. Receipt and Security of Test Materials 

3. Admission, Identification and Seating of Candidates 

4. On-site Test Administration Practices and Policies 

5. Timing of Subtest Sections 

6. Instructions for Completing AnWer Documents 

7. Special Arrangements for Handicapped Students 

Additional information to candidates is found in several other sources. 
Candidates are notified about Examination requirements, locations, and 
procedures in the Registration Bulletin . Specific directions to candidates 
about the assigned sat center and "necessary supplies are printed on the 
Admission Ticket. 



Scoring and Reporting 



Scoring 



The scoring process begins with a hand edit of the answer sheets, followed 
with the scanning of an initial set of sheets to verify the accuracy of the* 
scanner, the»key, and the scoring programs. The remaining sheets are scanned, 
and the data are divided into sets of 700 candidates. Three data sets are drawn 
using a systematic random sampling method lor the calibration of items using the 
Rasch methodology.. The items are adjusted to the base scale established by the 
April 1980 field test. A score table of equivalent raw scores to ability loglts 
is calculated and used to determine the ability loglts for the remaining 
candidates. Each person's score in ability loglts is then transformed to a 
scale score with 200 as the minimum passing score. For a discussion of the 
procedures used to establluh the cutting score see the technical discussion in 
Bullet in IV . • 

' * . 

* The essay is rated by three readers who use a four-point scale defined in 
State Beard of Education rules. The resulting scores range from three to twelve 
points. The passing standard is set at six points. Details of the criteria for 
the rating of essays are available in Bulletin II . 

Reporting 

The reports generated for each administration include a candidate report 
and score interpretation guide, reports for institut ions, and state level 
reports. 
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Candidate reports Indicate whether or not a test is passed; scaled scores 
are reported only for tests failed. Scores above the passing standard are not 
reported* *Howeve«- t candidates who fall one or more tests are provided their 
scale score for each subtest filled. A detailed analysis of performance Is 
provided to individuals who fall the Professional Education Subtest* 

* 

The reports generated for the institutions and the state are listed below: 

1. Number and Percent Passing for; 
a* Each subtest 

b. All four subtests 

c* Three, two, one or no subtests ,x 

2. Number, Percent Passing a*nd Mean Scores for *-ach Subtest!" and the 
Total Examination by All Ca^-Hdates and: + 

aw First -time candidates 

b. Re-take candidates 

c. Vocational candidates '* 
dw Non-vocational candidates 

e* Florida candidates 

1 • Non-*lorida candidates 

g% FT- a\? 'a candidates froa approved degree programs 

h. FLm Ja candidates from non-appruved programs 

1* Sex and ethnic categories 

N 3- dumber and Percent of Candidates by Florida Institutions and by 
Programs, Passing All Subtests and Each Subtest 

4. Number and Percent of Candidates Passing All Subtests and Each 
Subtest by Program Statewide 

5. Frequency Distribution for All Candidates for Each Subtest by Sex 
and Ethnic Category 

6. Frequency Distribution for Each Subtest for Florida Institution 

Statistical analyses of data are reported in the sections on the 
psychometric characteristics of the Examination. 
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TEST RESULTS FOR 1980-1981 



The results of the three administrations of the Examination during 
1980-1981 were summarised in the first annual -report. Data from this annual 
report are displayed in this chapter. 

The overall passing rates for the first three administrations of the 
Examination- are shown in Table 2. As can he seen from the data, there are no 
differences between the results for first-time test takers as opposed to the 
results from all candidates. As more and more re takers enter the testing cycle, 
the results shown in these two columns may be expected to differ slightly. 



TABLE 2 

Percent of Candidates Passing All Parts 
' of the FTCE from November 1980^*rough 
August 1981 



First-Time , All 

Candidates Candidates 



November 1980 > 79 79 

April 1980 83 83 

August i981 80 80 



Tables 3 through 6 on the following pages show: (a) the number and percent 
of candidates passing all subtests and each subtest by program, statewide tor 
first-time candidates and for all candidates; and (b) the same information for 
vocational-technical prograo area candidates. 



TABLE 3 fl 

FLORIDA TEACHER CERTIFICATION EXAMINATION 

NUMBE* AND PERCENT PASSING ALL SUBTESTS ADO EACH SUBTEST BY PROGRAM STATEWIDE 

TOR 

FIRST -TIME CANDIDATES 1980-1981 



PROGRAM 



1 ADMINISTRATION/ SUPER VISION 

2 VOCATIONAL AGRICULTURE 

3 GEN „AG 

4 ART EDUCATION 

5 BIBLE 

6 BUSINESS EDUCATION 
9, BOOKKEEPING 

12 EARLY CHILDHOOD ED. 

13 VARYING EXCEPTIONALITIES 

14 HEARING DISABILITIES 

15 VISUAL DISABILITIES 

17 MENTAL RETARDATION 

18 SPEECH CORRECTION 

20 ELEMENTARY EDUCATION 

21 ENGLISH 

22 GUIDANCE 

23 HEALTH EDUCATION 

24 VOCATIONAL HOME ECONOMICS 

25 GEN HOME ECONOMICS 

26 PNJmSTRfAL ARTS 
30 GRAPHIC ARTS 

33 JOURNALISM 

35 FRENCH 

36 SPANISH 

37 LATIN 

38 GERMAN 

43 MUTATIONAL MEDIA SPECIALIST 

44 MATHEMATICS 

45 MUSIC EDUCATION 

46 PHYSICAL FDUCATION / 

49 SCIINCr; 

50 CHI Ml S i RY 

51 PHYSICS 

52 r?ouk;y 

56 SOCIAL SYUD1ES 

57 II) S3 1 m 

58 Pol. UK \|. SCIENCE 



TOTAL 3 
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4 


100.(3 




4 


4 


100.0 


73 


66 


90.4 


73 


67 


91.8 


73 


70 


95.9 


73 


69 


94.5 




73 


70 


95.9 


81 


65 


80.2 


81 


77 


95.1 


81 


73 


90.1 


81 


70 


86.4 




81 


77 


95.1 


62 


49 


79.0 


62 


58 


93.5 


62 


57 


91 .9 


62 


51 


82.3 




62 


56 


90.3 


28 


J7 


60.7 


28 


24 


85.7 


28 


26 


92.9 


28 


20 


71.4 




28 


25 


89.3 



15 



16 



ERIC 



PROGRAM 



TOTAL EXAM 



SUBTESTS READ 



HATH 



PROP BP 



59 ECOKOHICS 

60 SOCIOLOGY 

62 SPEECH 

63 VISITIKC TEACHES 

70 ADMINISTRATION, ADULT ED 

74 PSYCHOLOGY 

75 IHSTRUHESTAL HUSIC 
114 ADMINISTRATION 
132 HUMANITIES* 

134 TECHNICAL EDUCATION 

145 SPECIALIST IN SCHOOL PSY. 

146 READING 

148 SCHOOL FOOD SERVICE 

150 DRAMA 

153 HUSIC VOCAL 

154 HUSIC INSTRUMENTAL 

175 ADMN-SUPERVIS/EHO DISTURB 

178 EARLY CHILD. ED /EL EH. ED. 

184 ELEH/EHOTIONAL DISTURBANCE 

185 ELEM/HEARINC DISABILITY 

186 ELEN/HENTAL RETARDATION 
189 EL EM/HID SCIENCE 

191 ELEM/N1D SPEC. LEARN DISABTL 

194 EMOTIONAL/HBNTAL/LEARN/VARYINC 

195 mn I oNAL/HENTAL/ SPEC I FIC 
1 97 EMOTIONAL/ SPECIFIC/ VARY INC 

200 EARTH SCIENCE 

201 EMOTIONAL DISTURBANCE 

202 SPECIFIC LEARN. DISABILITIES 
205 HEALTH OCCUPATIONS ED* 

222 

302 KNCJJSll/CERMAN 

310 ENGLISH/SPEECH 

315 FRENCH /SPANISH 

320 HEALTH /PHYS EDUCATIOH 

327 INIHtSTRIAL ED/ TECH ED 

34? SCIENCE/MATH 

351 SPECIFIC LEARN DISABIL/ELEH 

355 A<; & NATURAL RESOURCES 

356 ARCH I TEC 4 ENVIRON DESIGN 

357 AREA STUDIES 

158 »nH.m;irAL sciences 

159 Ht'Sttt.SS, COMMERCE, MANAGEMENT 

160 Ci»M>«:Nl^\TION 



13 
57 
14 
26 
2 
98 



26 
9 



32 
14 



10 
36' 
14 
20 
1 
76 
1 
1 
6 
0 
.4 
6 

2 

** 

1 
1 

1 
53 
1 
4 
1 
1 
5 
1 
5 
6 
1 
20 
66 
1 
0 
' 1 
3 
3 
2 
1 
J 
1 

19 
I 
I 
5 
25 
II 



76.9 
63.2 
100,0 
76.9 
50.0 
77,5 
100.0 
33.3 
85.7 
0,0 
100,0 
100.0 
100. 6 
66.7 
100.0 
100.0 
100.0 
81.5 
100,0 
100,0 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
33.3 
76,9 
90.5 
100.0 
0.0 
,100.0 
,100.0 
100. 0 
100.0 

too.o 

50.0 
100.0 
90 .-5 
^0.0 
100.0 
100.0 
78.1 
78.6 



13 
58 
14 
26 

2 
98 

1 

3 

7 

1 

4 

6 

2 

3 

•! 

l 
65 

K 

4 

1 

1 

5 

1 

5 

6 

3 
26 
95 

1 

2 

I 

3 

3 

2 

1 

2 

1 
21 

2 

1 

5 
32 
14 



11 

50 
14 
22 
1 
89 
1 
2 
7 
1 
4 
6 
2 
2 
1 
1 
I 
61 
1 
4 
1 
1 
5 
1 
5 
6 
3 
22 
93 
1 
2 
1 
3 
3 
2 
1 
2 
1 
21 
1 
1 
5 
30 
14 



84. 6 
86.2 
100.0 
84.6 
50.0 
90.8 
100.0 
66.7 
100.0 
100.0 
100.0 
100.0 
100.0 
66.7 
100.0 
100.0 
100.0 
93.8 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
84,6 
97.9 
100.0 
100.0 
100. 0 
100.0 
100. 
100. 
100. 
100. 
100. 
100.0 
50.0 
100.0 
100.0 
93.8 
iOO.O 



.0 
.0 
.0 
.0 
.0 



13 
58 
14 
26 

2 
98 

1 

3 

7 

1 

4 

6 

2 

3 

1 

1 

1 
65 

1 

4 

I 

1 

5 

1 

5 

6 

3 
26 
95 

1 

2 

1 

3 

3 

2. 

1 

2 

1 
21 

2 

1 

5 
32 
14 



13 
51 
14 
23 

2 
90 

I 

2 

6 

0 

4 

6 

2 

2 

1 

1 

1 
61 

1 

4 

1 

1 

5 

1 

5 

6 

3 
23 
9V 

1 

2 

1 

3 

3 

2 

1 

2 

1 

21 

1 

1 

5 
29 
14 



100.0 

87.9 
100.0 

88.5 
100.0 

91.8 
100.0 

66.7 

85.7 
0.0 
100.0 
100.0 
100.0 

66* 7 
100.0 
100". 0 
100.0 

93.8 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 

88.5 

98.9 
100.0 
100.0 
100.0 
100.0 
1000 
10C.0 
100.0 
100.0 
100.0 
100.0 

50.0 
100.0 
100.0 

90.6 
100.0 



13 a 
58 
14 
26 

2 
98 

1 

3 

7 

1 

4 

6 

2 

3 

1 

1 

1 
65 

1 

4 

1 

1 

5 

1 

5 

6 

3 
26 
95 

1 

2 

1 

3 

3 

2 

1 

2 

1 
21 

2 

1 

5 
32 
14 



10 
38 
14 
20 
2 
80 
1 
2 
6 
1 
4 
6 
2 
2 
1 
1 
1 

54 
1 
4 
1 

1 
5 
1 
5 
6 
1 
21 
86 
1 
0 
1 
3 
3 
2 
1 
2 
1 
20 
2 
1 
5 
29 
11 



76.9 
65.5 

■as 

100.0 
81.6 
100.0 
66.7 
85.7 
100.0 
100.0 
100.0 
100.0 
66.7 
100.0 
100.0 
100.0 
83.1 
100.0 
100.0 
100.0 
100.0 
.0 
.0 
100.0 
100.0 
33.3 
80.8 
90.5 
100.0 
0.0 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
95.2 
.0 
100. 0 
100. 0 
.6 
.6 



100.1 
100.1 



13 
57 
14 
26 
2 
98 
1 
3 
7 
1 
4 
6 
2 
3 
1 
1 
1 
65 

1 
4 
1 
1 
5 
1 
5 
6 
3 
26 
95 
1 



11 
47 
14 
23 
2 
B8 
1 
2 
7 
1 
4 
6 
2 
2 
1 
1 
1 
62 
1 
4 
1 
1 
5 
1 
5 
6 
3 
25 
94 
1 



0 

ERIC 



17 




84.6 

82.5 
100.0 

88.5 
100.0 

89.8 
100.0 

66.7 
100.0 
100.0 
100.0 
100.0 
100.0 

66.7 
100.0 
100.0 
100.0 

93.4 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 

96.2 

98.9 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 
100.0 

50.0 

'loo.e 

95.2 
100.0* 
100.0 
100.0 

96.9 
100.0 



PROGRAM 



\ 



TOTAL EXAM 





• 

o 


T 


« 


m 

X 


JOZ 


vWrvitK a iNru ovISffCE 


2 


2 


100;0 


EDUCATION 


77 


63 


81.8 




SHulNMllIliE * TKCnffOL 




4 


100,0 


JO* 


nils' a Afoot ton iimt 


5 


3 


60*0 


JO 2 


rVKtiufli mwHIAmm 


* 
4 


2 


50,0 


Iftft 
JDO 




33 


31 


93,9 


1A7 
JO I 






2 


50.0 




1 AM » ,' 


fit 
21 


14 


00.7 


IftO 

JO* 


LtTTLKD m 


10 


8 


80*0 


17n 




0 

8 


, 7 


87.5 


171 
J# 1 




M 

4 


3 


75.0 




puvtt T f* a t oi*t rar* re 


2 


1 


50*0 


171 
Jl J 




J 


3 


100.0 


374 


PUBLIC AFFAIRS • SERVICE 


27 


23 


85. 2 


375 


SOCIAL SCIENCES 


21 


18 


85.7 


377 


DECKE* V0CATI0HAL 


17 


15 


88.2 


550 


VOCATIONAL EDUCATION DIRECTOR 


1 


0 


0.0 


589 


INDUSTRIAL EDUCATION 


6 


3 


50.0 


632 


DISTRIBUTIVE EDUCATION 


2 


2 


100.0 


706 




2 


0 


0.0 


B01 




1 


0 


0.0 


804> 




2 


0 


0.0 


822 




1 


0 


0.0 


823 




1 


0 


0,0 


830 




? 


0 


0.0 


900 




,1 


0 


0.0 



SUBTESTS READ 




WRITE 






MATH 




PROF CD 




T 


M 

W 


m 


T 


N 


Z 


T 


N 


t 


r h 


% 


2 


A , 


inn n 

AMI. If 


2 


2 


100.0 


2 


t 2 


100.0 


2 2 


100.0 


77 


7fl 
III 


Oil Q 
Til • 7 


77 


69 


89*6 


7? 


67 


87.0 


77 ~69 


89 6 


4 




inn n 


4 


4 


100.0 


4 


4 


100.0 


4 4 


100.0 


■j 




inn n 


% 


5 


100.0 


5 


3 


60.0 


*5 4 


80.0 


A 
■t 


1 


7^ n 
i^.ii 


4 


2 


50.0 


4 


3 


75.0 


4 3 


75.0 


11 


11 


inn n 

A VII. II 


33 


32 


97.0 


33 


31 


93.9 


13 33 


100.0 


A 


A 
** 


inn n 


4 


4 


100.0 




3 


75.0 


4 ' 2 


50.0 


* A 


1 A 
AO 


1 0 » A 




47 


81.0 


21 


18 


85.7 


21 20 


95.2 * 


in 


All 


inn n 

AW. II 


10 


10 


100.0 


10 


8 


80 W 


10 10 




A 
O 


a 

Q 


inn n 

AUv.fl 


8 


8 


100,0 


8 


7 


"87.5 


8 8 


100.0 


A 


A 


1 Aft A 


4 


3 


75.0 


4 


3 


75.0 


4 4 


100.0 


A 


A 


Iwv«V 


2- 


1 


50.0 


2 


2 


100.0 


2 1 


10.0 




J 


1 AA A 


3 


3 


100.0 


3 


3 


10%). 0 


3 3 


100.0 


27 


25 


92*6 


27 


25 


92.6 


27 


24 


88.9 


27 25 


92.6 


21 


20 


95.2 


21 


19 


90.5 


21 


19 


90.5 


21 20 


99% 2 


17 


16 


94.1 


17 


17 


100.0 


17 


16 


94.1 


17 17 


200.0 


1 


1 


100.0 


1 


0 


0.0 


1 


1 


100.0 


1 1 


100.0 


6 


5 


83.3 


6 


4 


66.7 


6 


5 


83.3 


6 6 


100.0 


2 


2 


100.0 


2 


2 


100.0 


2 


2 


I0P 4 


2 2 


100.0 


2 


2 


100.0 


2 


0 


0.0 


2 


2 


Hki.O 


2 2 


100.0 


1 


1 


100.0 


1 


1 


100.0 


1 


0 


0.0 


1 1 


100.0 


2 


1 


50.0 


2 


1 


50.0 


2 


1 


50.0 


2 1 


50.0 


1 


1 


100.0 


1 


0 


0.0 


1 


0_ 


_ 0.0 


1 1 


100.0 


1 


1 


100.0 


1 


1 


100.0 


I 


0 


0.0 


1 1 


100.0 


3 


3 


100.0 


3 


3 


100.0 


3 


0 


0.0 


3 2 


66.7 


1 


1 


100.0 


J 


1 


100.0 


1 


3 


0.0 


1 1 


100.0 



\ 



19 



£0 
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TABLE 4 



rXOSIDA TEAtSES CERTIFICATION EXAMINATION 

NUMBER AND PKHCBBT PASSIM! ALL SUBTESTS AND EACH SUBTEST BY PROGRAM STATEWIDE 

FOR 

ALL CANDIDATES 1980-1981 



PROGRAM 


-TOTAL EXAM 


SUBTESTS READ 




WRITE 


- 




HATB 






DDA0 m 

PRvr ED 








T 


H 


% 


T 


N 


I 


T 


n ., 




T 


i? 


X 


T 


8 


v.-ft . 


I 


ADMNIS^TION/SUPBSVISION 


6 


4 


66.7 


6 


5 


83.3 


A 

o 


A 
A 


06* 7 


• 

ft 
A 


6 


t AA A 
llHf .O 


a 
o 


A 
9 


1 AA A 


2 


VOCATIONAL AGRICULTURE 




1 


100.0 


1 


1 


100.0 


1 


1 


i aa n 


1 
1 


1 


1 AA A 

100.0 


i 
i 


A 


| AA A 


3 


GEN AC 


^ * 


2 


100.0 


2 


2 


100.0 


9 
ft 


9 

ft 


1 AA ft 


4 


m 
m 


f AA A 


9 
ft 


9 
ft 


too A 


4 


ART EDUCATION 


B6 


70 


81.4 


88 


84 


95.5 


aft. 

59 


79 


Q1 A 

9i«9 


AA 


9ft 
79 


Ail A 
99.9 


Ail 
99 


HI 
97 


98*9 


5 


BIBLE 


5 


5 


100,0 


5 


5 


100.0 


• ft 
3 


3 


« Ml A 

10ft. u 


ft 


ft 

3 


9 AA A 

100.0 


ft 
3 


ft 

3 


f ,9|*f A 


6 


BUSINESS ElJUCATION 


49 


39 


79.6 


49 


42 


85.7 


AA 

49 


A ft 


At A 
91 .If 


" Aft 

49 


AA 


AA A 
99.9 


AA 


99 


Oft fi 

9W»9 


9 


BOOKKEEPING 


15 


14 


93.3 


15 


15 


100.0 


% ft 
13 


4 A 


a« 9 

93.3 


• ft 

13 


1 ft 

13 


9 AA A 

aW.I1 


1 ft. 
13 


1 ft 

13 


•J AA A . 


12 


EARLY CNIUffim BO. 


26 


23 


68.5 


H 


24 


92.3 


26 


9ft 

Z3 


Aft % 

96. 2 


9A 
AO 


Aj 


OA ft 
99 • J 


9 ft. 
ftA 


9ft 


Aft 9 

99* ft 


13 


VARYING EXCEPTIONALITIES 


2 


1 


50.0 


2 


2 


100.0 


2 


1 


ftA A 

50.0 


9 

2 


9 

2 


• AA A 


9 
ft 


«v 


i AA |% 


14 


HEASl»G DISABILITIES 


14 


14 


100-0 


14 


14 


106. 0 


1 A 

14 


14 


lOU.U 


1 A 

14 


t A 

14 


* AA A 
lW.U 


1 A 
1* 


1 A 
19 


1AA A 


15 


VISUAL DISABILITIES 


13 


12 


92,3 


13 


13 


100.0 


1 9 


1 9 


i An a 


A J 


1ft 


A*l 1 

92. J 


I 9 
1 J 


4 9 

13 


t AA n 


17 


MENTAL RETARDATION 


105 


89 


84.8 


105 


99 


94,3 


9 Aft 

105 


103 


99.X 


1 Aft 

IU3 


91 


Aft f 


1 Aft 

1U3 


1A9 

AUJ 


99.1 


ia 


SPEECH CORRECTION 


74 


65 


67.8 


74 


74 


100.0 


74 


9 ft 


100.0 


#4 


Aft. 


OA 9 

89* * 


9A 
/A 


91 

M 


9% II 
99*9 


20 


ELEMENTARY EDUCATION 


SS4 


71B 


81.2 


884 


809 


91.5 


gat 

885 


817 


A9 V 

92. 3 


993 




OA ft 

9A « 3 


OA ft 


933 


OA I 
99** 


21 


VENGLISN 


201 


181 


90,0 


201 


196 


*Ta 


201 


* Aft 

199 


AQ A 

99.0 


9 fit 
2U1 


•1411 

lol 


At A 
91 *v 


9At 


192 


AA A 
99*7 


22 


GUIDANCE 


40 


36 


90.0 


40 


38 


95.0 


Art 

40 


38 


Aft A 

95.0 


AA 
AU 


97 
J7 


99 ft 
9ft .3 


AA 
AU 


AA 


• AA A, 
lW*lf 


23 


H&CFlTMDUCATION 


22 


IB 


81.8 


22 


22 


100.0 


•9*9 

22 


20 


An a 
90.9 


22 


AU 


AA A 

9U*9 


99 
#* 


91 

AA 


93. 3 


24 


VOCATIONAL HOME ECONOMICS 


41 


33 


80.5 


41 


37 


90.2 


41 


X A 

40 


97.6 


A 1 

41 


35 


Aft A 
93.4 


Al 
■I 


" An 


99 A 


25 


GENERAL KOKE ECONOMICS 


5 


2 


40*0 


5 


3 


60.0 , 


> 


3 


An A 
00, U 


3 


• 


AA A 
All. II 


ft 

3 


9 


AA A 


26 


INDUSTRIAL ARTS 


6 


4 


66-7 


6 


5 


83.3 


ft 

6 


A 
A 


ftft 7 


ft 
o 




Aft % 


A 
9 


A 
9 


AUV.V 


30 


GRAPHIC ARTS 


1 


1 


100.0 


1 


1 


•100.0 


1 


1 

1 


1 ftA A 

100.0 


1 


i 

I 


1 AA A 


A 


t 
4 


ion 0 


33 


JOURNALISM 


13 


8 


61.5 


13 


13 


100.0 


13 


12 

A.* 


92.3 


13 


s 


61.5 


13 


12 


M.S 


35 


FRENCH 


10 


9 


90.0 


10 


10 


100.0 


10 


10 


100.0 


10 


9 


90.0 


. io 


10 


100.0 


36 


SPANISH 


36 


24 


66.7 


36 


28 


77.8 


36 


29 


80.li 


36 


25 


69.4 


36 


28 


77,8 


37 


LATIN 


1 


! 


100.0 


1 


1 


100.0 


I 


1 


100.0 


1 


1 


100.0 


1 


1 


100.0 


38 


GERMAN 


5 


4 


80.0 


5 


5 


100,0 


5 


4 


80.0 


5 


5 


100.0 


5 


5 


100.0 


41 


EDUCATIONAL HEDIA SPECIALIST 


21 


17 


81.0 


21 


20 


95.2 


21 


21 


100.0 


21 


17 


81.0 


21 


21 


100.0 


44 


mathematics 


90 


80 


88.9 


90 


84 


93.3 


90 


83 


92.2 


90 


88 


97.8 


90 


85 


94.4 


45 


HUSH: EDUCATION 


92 


73 


79* J 


92 


80 


87.0 


92 


84 


91.3 


92 




88.0 


92 


84 


91.3 


46 


PHYSICAL EDUCATION 


168 


117 


69.6 


168 


137 


81. 5 


168 


140 


83.3 


168 


133 


79.2 


168 


165 


86.3 


49 


SCIENCE 


17 


17 


100.0 


17 


17 


100.0 


17 


17 


100.0 


17 


17 


100.0 


17 


17 


100.0 


50 


CHEMISTRY 


6 


4 


66.7 


6 


5 


83.3 


6 


5 


83.3 


6 


6 


100.0 


6 


6 


100.0 


5i 


PHYSICS 


4 


3 


75.0 


4 


4 


100.0 


4 


3 


75.0 


4 


6 


100.0 


4 


4 


100.0 


52 


biology 


73 


67 


91.8 


73 


68 


93.2 


73 


70 


95.9 


73 


69 


94.5 


73 


7© 


9S.9 


56 


SOCIAL STUDIES 


f* 


67 


82.7 


81 


77 


95.1 


81 


74 


91.4 


81 


71 


87.7 


81 


78 


96.3 


57 


HISIOKY 


62 


50 


80.6 


62 


58 


93.5 


62 


57 


91.9 


62 


52 


83.9 


62 


5i 


90.3 


5» 


POLITICAL SCIENCE 


26 


18 


64.3 


28 


25 


89.3 


28 


26 


92. 9 


28 


21 


75.0 


28 


25 


89. 3 



21 



22 



23 



PROGRAM 



TOTAL EXA M 
T N • X 



suit 



SUBTE gTS REA D 

t it % 



VrtUTE 

N * 



MATH 



PSUF £1) 



59 


ECONOMICS 


13 


10 


76.9 


13 


11 


84.6 


13 


13 


100.0 


13 


10 


76.9 


13 


11 


B4.6 


60 


SOCIOLOGY 


57 


37 


64.9 


58 


50 


86.2 


58 


53 


91 ,4 


58 


39 


67.2 


57 


48 


84.2 


62 


SPEECH 


14 


14 


100.0 


„ 14 


14 


100.0 


14 


14 


100.0 


14 


!■* 


100,0 


14 


14 


100.0 


63 


VlSim; TEACHER 


26 


20 


76.9 


26 


22 


84.6 


26 


24 


92.3 


26 


20 


76.9 


26 


23 


88.5 


70 


ADMINISTRATION, ADULT ED 


2 


1 


50.0 


2 


1 


50.0 


2 


2 


100,0 


2 


2 


100.0 


2 


2 


100.0 


74 


PSYCHOLOGY 


98 


77 


78.6 


98 


89 


90.8 


98 


90 


91.8 


98 


81 


Q2.> 


98 


88 


89.8 


75 


INSTRUMENTAL MUSIC 
ADMINISTRATION \ 


1 


1 


100.0 


1 


1 


100.0 


1 


1 


100.0 


1 


1 


100.0 


1 


1 


100.0 


114 


3* 


2 


66.7 


3 


3 


100.0 


3 


2 


66.7 


3 


3 


100,0 


3 


2 


68.7 


112 


HUMANITIES 


7 


6 


85.7 


7 


7 


100,0 


7 


6 


85.7 


7 


6 


85.7 


7 


7 


100.0 


134 


^TECHNICAL EDUCATION 


1 


0 


0.0 


1 


1 


100.0 


1 


0 


0.0 


1 


1 


100.0 


1 


1 


100.0 


145 


SPECIALIST IN SCHOOL PSY. 


4 


4 


100.0 


4 


4 


100.0 


4 


4 


1(H). 0 


4 


4 


100,0 


4 




100.0 


146 


HEADING 


6 


6 


100.0 


6 


6 


100.0 


6 


6 


100,0 


6 


6 


100.0 


6 




100.0 


148 


SCHOOL FOOD SERVICE 


2 


2 


1(H). 0 


2 


2 


100,0 


2 


2 


100.0 


2 


2 


100.0 


2 


2 


u».o 


150 


DRAMA 


J 


2 


66.7 


3 


2 


66.7 


3 


2 


66.7 


3 


2 


66.7 


3 


2 


68.7 


153 


MUSIC VOCAL 


1 


1 


100.0 


1 


1 


100.0 


- 1 


1 


100. 0^ 
100*0 


1 


1 


100.0 


1 


1 


100.0 


154 


MUSIC INSTRUMENTAL 


1 


1 


100.0 


1 


1 


100.0 


1 


I 


1 


1 


100.0 


1 


1 


100.0 


175 


ADMIN- SUPERVIS/EMO DISTURB 


1 


I 


100.0 


1 


1 


100.0 


1 


1 


100.0 


I 


1 


100.0 


1 


1 


100.0 


178 


EARLY CHILD* ED/ELEM. ED« 


65 


54 


83.1 


65 


61 


93.8 


65 


62 


95.4 


65 


55 


84.6 


65 


63 


96.9 


184 


ELEM/ EMOTIONAL DISTURBANCE 


1 


1 


100.0 


1 


1 


100.0 


1 


1 


100.0 


1 


1 


100.0 


1 


1 


100.0 


185 


ELEM /HEARING DISABILITY 


4 


4 


100,0 


4 


. 4 


100.0 


4 


4 


100.0 


k 


4 


100, 0 


4 


4 


100.0 


186 


EL EM /MENTAL RETARDATION 


1 


1 


100.0 


1 


1 


100.0 


1 


1 


100.0 


i 


1 


100*0 


1 


1 


100.0 


189 


ELEM/MID SCIENCf 


1 


1 


100.0 


1 


1 


100. 0 


1 


1 


100. 0 


1 


1 


100.0 


1 


1 


100,0 


191 


ELEM/MID SPEC. LEARN DISAB1L 


5 


5 


100.0 


5 


5 


100.0 


1 


5 


100.0 


5 


5 


100.0 


5 


5 


100.0 


194 


EMOT IONAL/HENTAL/LEARN/VARYINC 


1 


I 


100.0 


1 


1 


100.0 


1 


1 


ljDO.O 


I 


1 


100.0 


1 


1 


100.0 


195 


EMOT I ONAL/MENTAL/ SPEC I FIC 


5 


5 


100.0 


5 


*> 


100.0 


5 


5 


;10fiho 


5 


5 


100.0 


5 


5 


100.0 


197 


EMOT I ONAL/SPBCIFIC/ VARY I MO 


• 6 


6 


100.0 


6 


b 


100.0 


6, 


6 


100.0 


6 


6 


100.0 


6 




100.0 


200 


EARTH SCIENCE 


3 


3 


100.0 


3 


J* 


100.0 


3 


3 


100.0 


3 


3 


100,0 


3 


3 


100.0 


201 


EMOTIONAL DISTURBANCE 


26 


21 


80.8 


26 


It 


84.6 


26 


23 


88.5 


26 


22 


84*6 


26 


25 


96.2 


202 


SPECIFIC LEARN, DISABILITIES 


95 


88 


92.6 


95 


*4 


98.9 


95 


94 


98.9 


95 


88 


92.6 ' 


95 


94 


98.9 


205 


HEALTH OCCUPATIONS ED. 


1 


1 


100.0 


1 


1 


100.0 


1 


1 


100.0 


1 


1 


100.0 


1 


1 


100.0 


222 




2 


\ 


50.0 


2 


2 


100.0 


2 


2 


200. 0 


2 


1 


50.0 


2 


2 


100.0 


102 


EN? *.L I SH /GERMAN 


I 


1 


100.0 * 


1 


1 


100*0 


1 


1 


100,0 


1 


I 


100.0 


I 


1 


10Q.0 


310 


VM,\ ISM/SPEECH 


3 


3 


100.0 


3 


3 


100. 0 


3 


3 


, 100,0 


3 


3 


100.0 


s 


3 


100.0 


315 


FKESUt/SPANISH 


3 


3 


100.0 


3 


3 


100.0 


3 


3 


100.0 


3 


3 


100.0 


3 




100.0 


320 


HEALTH/ PHYS EDUCATION 


2 


2 


100.0 


2 


2 


100.0 


2 


2 


100.0 


2 


2 


100,0 


2 


2 


100.0 


327 


INDUSfKIAL ED/TECH ED 


i 


! 


100.0 " 


1 


1 


100.0 


1 


1 


100.0 


] 


1 


100,0 


1 




100.0 


14 7 


SCII NCI /MATH' 


2 


? 


100.0 


2 


2 


100.0 


2 


2 


100.0 


2 


2 


100.0 


? 




100.0 


550 


SPECIF LEARN DISABIL/ELEM 


1 


i 


JOO.O 


1 


1 


100.0 


I 


I 


100.6 


1 


1 


100,0 


I 




100.0 


355 


AG 6 NATURAL RESOURCES 


21 


)9 


90.5 


21 


21 


100.0 


21 


21 


100.0 


21 


20 


95.2 


21 


20 


95. 2 


156 


ARUIITEC 6 ENVIRON DESIGN 


2 


1 


50.0 


2 


1 


50.0 


/ 2 


1 


50.0 


2 


2 


100,0 


2 


2 


100.0 


157 


AREA STUDIES ' 


1 


1 


100.0 


I 


1 


100.0 


i 


I 


100.0 


1 


1 


100.0 


i 


1 


100.0 


35H 


H10L«H.li:.\|. SCIENCES 


5 




100.0 


5 


5 


100.0 


5 


5 


100.0 


5 


5 


100.0 


5 


5 


100.0 


JV> 
jbi) 


M'SIMSS, COMMERCE . MANAGEMENT 
COMMl NH aTION 


32 
14 


2b 
\'J 


8t. J 

85.7 t 


32 
14 


30 
14 


93.8 
100.0 


12 
14 


30 
14 


93.8 
UKKO 


J2 
14 


ii 
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PROCJUM 



TOTAL EXAM 



SUBTESTS READ 



WRITE 



MATH 



PROF CD 







A 


Pi 


* 


T 


N 


X 


T 


N 


X 


T 


N 


% 


T 


N 


X 


361 


COMPUTER 6 INFO SCIENCE 


2 


2 


100,0 


2 


2 


100.0 


2 


2 


100.0 


2 


2 


100.0 


2 


2 


100.0 


162 


EDUCATION 


77 


65 


84.4 


77 


71 


92.2 


77 


70 


90.9 


77 


67 


87.0 


77 


70 


90.9 


163 


ENGINEERING 6 TECH NO L 


4 


4 


100.0 


4 


4 


100.0 


4 


4 


100.0 


4 


4 


100.0 


4 


4 


100,0 


364 


FINE 6 APPLIED ARTS 


5 


3 


60*0 




5 


100.0 


5 


5 


100.0 


5 


3 


60. 0 


^ 5 


4 


80.0 


165 


FOREIGN LANGUAGES 


4 


3 


75.0 


4 


3 


75.0 


4 


3 


75.0 


4 


3 


75.0 


4 


3 


75.0 


366 


HEALTH SERVICES 


33 


31 


93.9 


33 


33 


100.0 


33 


32 


97.0 


33 


32 


97.0 


33 


33 


100.0 


367 


HONE ECONOMICS 


4 


2 


50.0 


4 


4 


100.0 


4 


4 


100.0 


4 


3 


75.0 


4 


I 


50.0 


368 


LAV 


21 


14 


66.7 


21 . 


16 


76.2 


21 


17 


81.0 


21 


18 


85.7 


21 


20 


95 2 


369 


LETTERS 


10 


9 


90.0 


10 


10 


100.0 


10 


10 


100,0 


10 


9 


90.0 


10 


10 


100*0 


370 


LIBRARY SCIENCE 


8 


7 


07,5 


8 


8 


100.0 


8 


8 


lor.o 


8 


7 


87.5 


8 


8 


100.0 


371 


MATHEMATICS 


4 


3 


75,0 


4 


4 


100.0 


4 


3 


75.0 


4 


3 


75.0 


4 


4 


' 100.0 


171 


PHYSICAL SCIENCES 


S 2 


1 


50.0 


2 


I 


100.0 


2 


1 


50.0 


2 


2 


100. 0 


2 


I 


50.0 


373 


PSYCHOLOL'Y 


3 


3 


100.0 


3 


3 


100. 0 


3 


3 


100,0 


3 


3 


100.0 


3 


3 


100.0 


374 


PUBLIC AFFAIRS 4 SERVICE 


27 


23 


85.2 


27 


25 


92,6 


27 


25 


92.6 


27 


24 


88.9 


27 


25 


92.6 


375 


SOCIAL SCIENCES 


21 


18 


85.7 


21 


20 


95.2 


21 


19 


90.5 


21 


19 


90.5 


21 


20 


95.2 


177 


DEGREE VOCATIONAL 


17 


16 


94.1 


17 


17 


100.0 


17 


17 


100.0 


17 


16 


96.1 


17 


17 


100,0 


550 


VOCATIONAL EDUCATION DIRECTOR 


1 


1 


100. 0 


1 


I 


100.0 


1 


I 


100,0 


1 


1 


100. 0 


1 


I 


100.0 


589 


INDUSTRIAL EDUCATION 


6 


3 


50.0 




5 


83.3 


6 


*. 


66,7 


6 


5 


83.3 


6 


6 


100.0 


637 


DISTRIBUTIVE EDUCATION 


2 


2 


100,0 


- 1 


2 


100.0 


2 


2 


100.0 


2 


2 


100.0 


2 


2 


100.0 


?0b 




2 


2 


100.0 


2 


2 


100,0 


2 


2 


100*0 


2 


2 


100.0 


2 


2 


100.0 


001 




1 


1 


100. 0 




I 


100.0 


1 


1 


100. 0 


1 


1 


100. 0 


I 




100.0 


804 




2 


I 


50. U 




3 


50,0 


2 


2 


100.0 


2 


I 


50.0 


I 




100.0 


022 




1 


i 


100.0 




1 


100.0 


1 


N 


100.0 


1 


1 


100.0 


I 


I 


100,0 


82 3 




1 


1 


100.0 




1 


100,0 


1 


i 


100.0 


1 


1 


100.0 


1 


I 


100.0 


810 




3 


3 


100,0 




i 


100,0 


3 


3 


1(H). 0 


3 


3 


100.0. 


3 


3 


100,0 


900 




1 


1 


100.0 




1 


10Q.0 


1 


I 


100.0 


1 


1 


100.0 


1 


i 


100.0 
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TABU 5 

FLORIDA TEACHES CEETIFI CATION EXAMINATION 
RESULTS FOR VOCATIONAL TECHNICAL FIRST TIME CANDIDATES 



1980-1981 

r 

TOTAL # # PASSED . X PASSED 

TOTAL TEST 305 251 5W 

READING 506 * 372 74X 

l&Wi^ 506 348 69X 

PROF ED 505 390 77* 

WRITING 507 172 73X 



\ 



TABLE 6 

FLORIDA TEACHES CERTIFICATION EXAMINATION 
RESULTS FOR ALL VOCATIONAL TECHNICAL CANDIDATES 
1980-1981 



TOTAL f t PASSED I PASSED 

TOTAL TEST 506 299 591 

READING 506 392 77 J 

MATH 5% 375 ?4X 

PROF ED 506 404 801 

WRITING 507 389 77% 
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PSYCHOMETRIC CHARACTERISTICS 

The psychometric characteristics of validity, reliability, item 
discrimination, and contrasting group performance of the Florida Teacher 
Certification Examination (FTCE) will be addressed in this section. Knowledge 
of the psychometric characteristics of assessment tests is necessary for 
evaluating the tests* 

Validity 

Validity refers to the relevance of inferences that are made from test 
scores or other forms of assessment. The validity of a test can be defined as 
the degree to which a test measures what it was Intended to measure. Validity 
is not an all-or-none characteristic, but a matter of degree. Validity is 
needed to ensure the accuracy of information thit is inferred from a test score. 

Specific types of validation techniques traditionally used to summarize 
educational and psychological test use — criterion-related validity 
(pvedlctive and concurrent), content validity, and construct validity — ar '_ . 
described in Standards for Educational and Psychological Measurement (APA, 1974, 
pp. 26-31). For the FTCE, the primary validity issue that must be addressed is 
the question of content validity* Content validity demonstrates that test 
behaviors constitute a representative sample of behaviors in a desired 
performance domain. The intended domain of the FTCE is that of entry-level 
skills as identified in. the statute requiring the Examination as a basis for 
certification. This statute (23K17, F.S.) provides that 

Beginning July 1, 1980. . .each "applicant for initial 
certification shall demonstrate, on a comprehensive written 
examination and through such other procedures as may be 
specified by the state board, mastery of those minimum 
essential generic and specialisation competencies and other 
criteria as shall be adopted into rules by tb*> state board. 

The statute addresses only the status at certification and does not require 
thai Inferences be made from test scores to future success as a classroom 
teacher. No claims have been made with regard to measurement of specific 
aptitudes or trsits, and no attempt has been made to establish relationships 
between the FTCE and independent concurrent or future criteria. It Is only 
claimed that the test adequately measures the skills for which it was developed. 
The construct and criterion-related validation approaches are not appropriate to 
the validity issues related to 'development and use of the FTCE. 

The content validity of the FTCE rests upon the procedures used to describe 
and develop test items and content areas. The Intended coverage of the test was 
determined by a process involving professional consensus to (1) identify 
competencies which should be demonstrated as a condition for certification, and 
(2) Identify subskills associated with each competency. The procedures by which 
the intended coverage was identified included surveys of the profession, reviews 
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by the Council on Teacher Education (COTE), reviews by the ad hoc COTE task 
force, and reviews by teachers and other professional personnel. 

The general procedures used in test development were as follows: 

1. The Intended test coverage was identified and explicated. Competencies 
and subskills associated with each competency were Identified and 
validated. 

2. Test item specifications were developed and validated. 

3. Draft items were written according to test item specifications and 
pilot-tested on a small sample of senior students preparing to *»e 
teachers • 

4. The final item review consisted of (a) a review by a special 
panel comprised of classroom teachers, teacher educators, and 
administrators, and (b) item field-testing with seniors who 
were in teacher education programs. This was followed by 
another review by Department of Education staff. Items were * 
subsequently placed in the item bank for future use. * 

5. Field-test data were reviewed by Department of Education staff. Items 
that did not perform we'll were deleted from the item bank or revised 
and field-tested again. 

For the final item review process outlined in the fourth step, the items 
were divided by test area and reviewers were divided by area of expertise. The 
process included a review of item content, group differences la performance, and 
technical quality. Bulletin IV (pp. 13-17) contains farther Information about 
the development and review of test items. 

In summary, the validity of the Examination has been well established as a 
result of (1) the extensive involvement of education professionals in the 
identification and explication of the necessary competencies snd their 
associated subskills, (2) the precise item specifications which guided the item 
writers, and (3) the reviews of the Items and the competencies/ ski lis that they 
were designed to measure. 

Reliability of Test Scores* 

Reliability refers to the consistency between two measures of the same 
performance domain. Although reliability does not ensure validity, it limits 
the extent to wh^ch a test is valid for a particular purpose. The main 
reliability consideration for the FTCE multiple-choice tests (Reading, 
Mathematics, and Professional Education) Is the reliability of an individual's 
score. For the Writing test, a production writing sample, the reliability 
consideration is the reliability of the judges' ratings. The data in this 
section refer to the f*rst three FTCE administrations (1980-81). For 
information about fiela test reliability data, refer to Bulletin IV (1981). 
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Reliability of multiple-choice tests 



A test score Is comprised of a "true" score ("domain" score) and an "error" 
score. If an individual £ook several forms of a test, all constructed by 
sampling from the defined item domain, scores on the various test forms would 
not vary except as a result of random errors associated with item sampling 
errors and changes within an individual from one test to another related to 
attention, fatigue, interest, etc. 

Reliability evidence la generally of two types: (a) internal consistency, 
which is essential if items are viewed as a sample from a relatively homogeneous 
universe; and (b) consistency over tlrae, which la Important for teats that are 
used for repeated measurement. For the PTCE, the^ primary reliability Issue 1b 
that of internal consistency. Since one form of the test is administered to 
examinees at each administration, the reliability concern is that of consistency 
of items within that particular test (homogeneity of items)* A test can be 
regarded as composed of as many parallel tests as the test has items, and every 
item is treated as parallel to the ^fcher items; in such a case, the appropriate 
reliability index is the Kuder-Richardson Formula 20 (KR-20) index. The KR-20 
formula is shown in Appendix B. 

The KR-20 index estimates the internal-consistency reliability of a test 
from statistical data on individual items. Separate KR-20 coefficients are 
calculated for the Reading, Mathematics, and Professional Education subtests for 
each FTCE administration. A high coefficient indicates that a test accurately 
measures some characteristic of persons taking it and means that the individual 
test items are highly correlated. The subtest KR-20 coefficients for the first 
three test administrations were above .80, indicating that the individual test 
items were highly consistent measures of the three subject areas assessed. 
Refer to Table 7 for the KR-20 coefficients. 

Table 7 

Kuder-Richardson Coefficients 



Professional 
Math Reading Education 

November 1980 .89 ••J-vy> « 83 

April 1981 .88 .86 .85 

August 1981 .88 .90 .85 
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Reliability of the passing standards for the objective tests is estimated 
with the Brennan-Kane (B-K) Index of Dependability. This Index is an estimate 
of the consistency of test scores in classifying examinees as masters or 
nonmasters of the minimal performance standards* The high B-K, coefficients of 
Che tests (refer to Table 8) indicate that the candidates' scores are consistent 
with their classification as masters or nonmasters. Refer to Appendix B for the 
statistical formula-for the B-K Index. 



TABLE 8 
Brennan-Kane Indices 



Professional 
Math Reading Education 

November 1980 .93 .96 .96 

April 1981 .94 .93 .97 

August 1981 .94 .94 .96 



Reliability of scoring of the writing subtest 

The major reliability consideration for the Writing test is the 
inter-judge reliability of ratings. The Writing test is a production writing 
sample that addresses one of two specific topics. The essays are rated 
independently by three judges with a referee to reconcile discrepant scores. 
Original reliability data were obtained from a study in which essays were 
written by 360 teacher education students at two universities. Raters were 
trained by the same procedures which are being used in the actual test 
administrations. The reliability of the scoring process is monitored at the 
University of Florida for each test administration. (Refer to Appendix D for 
additional Information about the scoring of the Writing test.) 

Two approaches are used to estimate the rellablity. First, four indices 
of inter-rater agreement are computed. These four indices are: (a) percent 
complete agreement; (b) average percent of two of the three raters agreeing; 
(c) average percent agreement by pairs as to pass/fall; and (d) percent 
complete agreement about pass/fall. The second approach for reliability 
estimation is the calculation of coefficient alpha for the raters and the rating 
team. This coefficient indicates the expected correlation between the ratings 
of the team on this task and those of a hypothetical team of similarly comprised 
and similarly trained raters doing the same task. Field test inter-rater 
reliability data and coefficient alpha for the inter-rater reliabilities are 
reported in Tables 3.4 and 3.5 of Bulletin IV (pp. 22-23). Refer to Table 9 for 
rater reliability data for the 1980-1981 FTCE administrations. 
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TABLE 9 

Percentage of Rater Agreement Including 
Referee Score 





November 
1980 . 


April 
1981 


August 
1981 


• 

Index 1 - X Complete Agreement 


48.43 


33.70 


45.96 


Index 2 - Average Z Two of the Three 
Raters Agreeing 


97.90 


99.74 


99.93 


Index 3 - Average X Agreement by 
Pairs as to Pass/Pail 


97.41 


97.74 

* 


97.67 


Index 4 - X Complete Agreement 
About Pass/Fall 


7D.4J 


Qp* 




Topic 1 

Coefficient Alpha 


.86 


.78 


.84 


Topic 2 


.86 


.82 


.84 



Examination of the reliability data for the Writing test indicates that the 
level of reliability achieved by the rating teams met acceptable standards for 
such ratings. 

Discrimination 

Item analysis for the FTCE Includes examination of the items* capacity to 
differentiate between ability groups and the evaluation of response patterns to 
the individual items. The item analysis indices used are item difficulty level, 
item discrimination index, and point-biserial correlation coefficients. 

Item difficulty level — the pet cent age of examinees who answer each item 
correctly — is calculated for each item. These percentages provide important 
information because items in the moderate range of difficulty differentiate 
relatively more ex*' Lnees from each other than do extremely easy or extremely 
difficult items. 

Related to the Item difficulty level Is the Item discrimination index (see 
page 37 in the Appendix) , or the extent to which each item contributes to the 
total test in terms of discriminating|between the high and low achievers with 
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regard to the total test score. Any Item that Is below .20 on this index is 
evaluated for content and ambiguity of wording. I teas that appear to be flawed 
are revised or eliminated. The ranges for item difficulty level and 
corresponding itea discrimination indices are reported in Table 10. 



The number and percent of examinees who select each alternative response 
(foil) were reported for each itea in the multiple-choice tests. This foil 
analysis permits further evaluation of response patterns to the individual items 
and provides useful information about variations in response performance by 
different groups. These data are provided to the Department of Education staff 
and appropriate subcontractors and are not reported in this document. 

Point-blserlal correlation coefficients Indicate the extent to which 
examinees with high test scores tend to answer an item correctly and those with 
low test scores tend to miss an item. While the Item discrimination index is 
based on the performance of high and low achievers, the point-blserlal 
coefficient includes the entire range of scores in the correlation, thereby 
Indicating the item-total correlation or the extent to which an item score 
correlates with all other Items measuring a particular subject area. 
Statistical formulas for these indices are listed in Appendix B. 
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TABLE 10 

Ytmqmmacy of Itm witfeln Specific > 
U*» pit f lculty gnj Itjg PUcriainattloa Bagggs 





.0-.10 


.11-. 20 


.21-. 30 


I tan 

.31-. 40 


Discrimination Kaaga 
.41-. 50 .51-. 60 


.61-. 70 


.71-. 80 


.81-. 90 


.91-1.00 


TOTAL 


» .81-1*00 


6 


25 


35 


14 


4 


1 


0 


0 


0 


0 


85 


a .61- .80 


0 


0 


0 


5 


11 


14 


4 


0 


0 


0 


34 


£ 8 .41- ,60 


0 


0 


0 


0 


"b 


0 


0 


1 


0 


0 


1 


g g .21- .40 


0 


0 


0 


- 0 


0 


0 


0 


0 


0 


0 


0 


§ .0* .20 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


~ TOTAL 


6 


25 


35 


19 


15 


IS 

• 


4 


1 


f 


0 


120 




* 

.0-.10 


.11-. 20 


.21-. 30 


READXKC % 
Itew Dlacrlalnatlon Bangs 
.31-. 40 .41-. 50 .51-. 60 


.61-. 70 


.71-. 80 


.81-. 90 


.91- 1.00 TOTAL 


* .81-1.00 


124 


37 


13 


6 


2 


0 


0 


0 


0 


0 


182 


g .80 


0 


0 


2 


4 


6 


3 


2 


0 


0 


0 


17 


£ £ .41- .60 
o J .21- .40 
g .0- .20 


0 


0 


0 


0 


1 


1 


2 


0 


0 


0 


4 


0 


0 


1 


0 


1 


0 


0 


' o 


0 


W" 

0 


2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


w TOTAL 


124 


37 


16 


10 


10 


A 


4 


0 


0 


0 


205 
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u 

v4 SO 

B 



,0-.10 .11-. 20 



.21-. 30 



PROFESSIONAL EDUCATION 
I tea Discrimination Range ' 

.31-. 40 .41-. 50 .51-. 60 .61-. 70 



.71-. 80 .81-. 90 



.81-1.00 


21 


35 


47 


9 


0 


0 




0 


0 


0 


.6!- .80 


^- 


21 


31 


38 


14 


1 




0 


0 


0 


.41- .60 




4 


4 


13 


5 




0 


0 


0 


0 


.21- .40 


1 


0 


o I 


3 


0 




0 


0 


0 


0 


.0- .20 


0 


0 


— n 


\—r~. 


0 


0 


0 


0 


0 


0 


TOTAL 


26 


60 


82 


63 


19 


2 


0 


0 


0 ■ 


0 



.91-1.00 TOTAL 
112 
109 
27 
4 
0 
252 
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Meant and ranges for the point-bi aerial correlation coefficients for the 
first three test administrations are reported in Tables 11 and 12. 



TABLE ii 



Mean Po in t-Bi serial 
Correlation Coefficients 



November 1980 
April 1981 
August 1981 



Math 
.43 
.43 
.43 



Reading 
.27 
.35 
.38 



Professional 
Education 

.25 

.29 

.28 



TABLE 12 

Pol a t-Bi serial Correlation Coefficients Between 
Correct Iten Response and Subtest Score 



Range of 
Polnt-Biserlal 
Coefficients 



Math 



Reading 



Professional 
Education 



.90-.99 


0 


0 


0 


.80-. 89 


o 


0 


0 ' 


.70-. 79 


0 


0 


0 


.60-. 6 9 


5 


0 


0 


.50-. 59 


29 


8 




.40-. 49 


41 


52 




.30-.39 


34 


83 


95 \ 


.20-. 29 


10 


45 


* 85 


.10-. 19 


1 


15 


49 


.00-. 09 


0 


2 


7 


TOTAL ITEMS FOR 1980-81 


120 


205 


252 
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The appropriateness of mean point-biaerial correlation coefficients must be 
evaluated in the contest of a particular testing program. According to A 

j, Test Analysis Reports (ETS, 1981), the mean biserlal 
correlation will be higher wh en the examinee group represents a wide range of 
ability or knowledge or when the test items are very similar in content- Since 
the FTCE Reading and Professional Education tests are relatively easy, the 
scores were not greatly different. Thus, variability was reduced, and the 
polpt-blserlal correlation coefficients were attenuated. 

Contrasting Group Performance 

To~the~a»taat that scores on a test reflect group membership rather than 

the knowledge or skill that the test is designed to measure, the test is 
invalid. Although not all groups necessarily exhibit the same performance level 
in different areas of achievement, the procedure for analyzing contrasting group 
performance is to screen for any specific areas or items, pensive review 
procedures were used during FTCE development to ensure that the Examination 
content was an accurate representation of candidate performance in terns of the 
competencies being evaluated. The procedure included (a) a series of reviews 
SurJng the item development stage to screen for possibly offensive materials and 
for items that might invalidate examinee performance and (b) statistical 
analysis of field groups, ethnic groups, and program groups. These procedures 
are described in Bulletin IV (pp. 33-38). 

After each FTCE administration, test content is examined for contrasting 
.roup performance. Score distributions and summary ttatistics (including mean, 
medianrand standard deviation of the distribution and an index of skewness) are 
reported for each test. The content review for contrasting group performance 
includes (a) examination of scatterplots of performance on individual items and 
overall content by sex and ethnic category (male-female, black-white, 
whlte-hispauic, and hispanic-black) , (b) analysis of performance by groups based 
on their test scores, and (c) individual item analysis by sex and « thn ^ 
category to screen for Items that may discriminate negatively for a specific 

group. 

Scatterplots 

Scatter diagrams are graphic representations of the extent to which 
performance by two separate groups is related. Twelve scatterplots are produced 
for each FTCE performance by sex and ethnic category for each subtest. Entries 
that depart from the general pattern indicate that one group ^Performing 
differently from another group on specific items. In such cases, entries that 
depart substantially from the general pattern of other entries are "viewed for 
content that could account for differences in performance leyel. Items that are 
determined to be flawed during this review are revised or deleted from the item 
pool- An example of a scatterplot is illustrated Figure 1. 
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Figure i# Scatterplot of percent of examinees who answered specific items 
(entries) correctly* Performance for males is plotted on the 
vertical axis while performance for females is plotted on the 
horizontal axis* 



Subtest performance by groups 

The number and percentage of candidates who pass all subtests and 
individual subtests are reported by sex and ethnic designation after each FTCE 
administration. Table 13 displays these data* 
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TABU 13 

Kiwber and Percent Passing All subtests and 
Each Subtest by Total Candidate* and by Sam and Ethnic Designation* 

First Itoe Candidataa 





All 
Candidates 






Hal* 




Female 






Vhlta 






Slack 






TOT 


N 


X 


TOT 


N * 


I 


TOT 


N 


% 


TOT 


N 


I 


TOT 


s 


X 


ENTIRE TEST 


7508 


6103 


81 


1948 


1469 


75" 


5560 


4634 


83 


b(.2# 


5655 


88 


" 685 


223 


33 


HATH 


7519 


6501 


86 


1951 


1684 


66 


5568 


4817 


87 


6433 


5896 


92 


687 


328 


48 


READING 


751ft 


6905 


92 


1951 


1715 


88 


5565 


5190 


93 


6431 


6164 


96 


687 


666 


63 


PROF ED 


7517 


7076 


96 


1951 


1753 


90 


5566 


5323 


96 


6432 


6262 


97 


.686 


483 


70 


WRITING 


7516 


7011 


93 


1951 


17*0 


88 


5565 


3301 


95 


6431 


6220 


97 


687 


475 


69 



American Indian/ 



Asian 





Hispanic 




Alaskan Nativa 


Pacific 




Otkar 






TOT 


N 


t 


TOT 


N 


t 


TOT 


N 


% 


TOT 


S 




ENTIRE TEST 


263 


134 


51 


38 


29 


76 


16 


7 


44 


78 


53 


68 


MATH 


266 


176 


66 


38 


31 


82 


17 


11 


65 


78 


59 


77 


READING 


266 


161 


68 


36 


35 


92 


16 


11 


69 


78 


68 


87 


PROF ED 


266 


207 


78 


38 


37 


97 


17 


13 


76 


78 


74 


95 


WRITING 


266 


199 


75 


38 


36 


93 


17 


11 


65 


78 


70 


90 



* Hunbrt* in this tmble sr«pi«**ttt Uata ttom che first three FTCC adftinist rat ions (1960-1981), 
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Item analysis by sex and ethnic category 



Separate Item analyses — ■ Including Item difficulty levels f item 
discrimination Indices » polnt-biseriel correlations/ foil analyses (alternative 
response choices) f and KR-20 estimates of reliability — are reported for each 
sex and ethnic category* The item analysis process includes the screening of 
the individual test items that may discriminate negatively for a specific group* 
When an outlying entry Is identified on a scatter diagram, the item content is 
carefully reviewed to determine the necessity of deleting or revising the item. 
Foil analyses may also provide useful information with regard to contrasting 
group performance. Variations in response patterns by groups to different foils 
(alternative responses) may indicate the need for item revision. 

The procedures described in this section — including scatter diagrams y the 
analysis of subtest performance by groups, and item analysis by sex and ethnic 
category «— are used to ensure that scores obtained on the FTCE are accurate 
representations of the candidates 1 performance levels In terms of the 
competencies that are .addressed and are not a reflection of membership in a 
specific sex or ethnic category. 
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SUMMARY 



The Florida Teacher Certification Examination (FTCE) is an examination 
based upon selected competencies that have been identified by Florida educators 
as minimal entry-level skills for prospective teachers. In order to develop the 
Examination, the following tasks had to be accomplished: (a) planning; 
(b) writing and validation of test items; (c) field-testing the examination 
items; (d) setting passing scores; and (e) preparing for test assembly, 
administration, aud scoring. The competencies (described in Appendix A) have 
been adopted by the State Board of Education as currlcular requirements for 
teacher education programs in the colleges and universities in Florida. 

The FTCE consists of three objective tests (Reading, Mathematics, and 
Professional Education) and an essay test (writing) that is scored by trained 
readers. The general test content is as follows: 



Test 



Content 



Writing 
Reading 

Mathematics 



One of two general topics 

General education passages 
derived from textbooks, journals, 
state publications 

Basic mathematics: simple computation, 
and "real world" problems 



Professional 
Education 



General education including personal, social, 
academic development, administrative 
skills, exceptional student education 



Developmental items are Included in the examination along with regular test items. 
The developmental items are not counted in computing an individual's passing scor. 

The psychometri- characteristics of validity, reliability, item 
discrimination, and contrasting group performance of the FTCE are described in 
this report. The validity of the examination has been well established as a 
result of (1) the extensive involvement of education professionals in the 
identification and explication of the necessary competencies and their 
associated subskllls, (2) the precise Item specifications which guided the item 
writers, and (3) reviews of the items and the competencies/skills that they were 
designed to measure. The reliability data indicate that the test items are 
consistent measures of the three subject areas and that the examinees' scores 
are consistent with their classification as masters or nonmasters of the minimal 
performance standards. The reliability data for the Writing test demonstrates 
that the scoring by the writing teams meets acceptable standards of consistency. 
Item analyses for the FTCE examine the power of the items to differentiate 
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between ability groups and evaluate response patterns to individual items. The 
indices that are used to monitor the differences between ability groups are item 
percent correct* ltea discrimination index, and po in t-bi serial correlation 
coefficients. Additional Item analysis procedures — including scatter 
diagrams, the analysis of subtest performance by groups, and item analysis by 
sex and ethnic category — are used. These procedures ensure that scores 
obtained on the FTCE are accurate representations of the candidates' performance 
levels In terms of the competencies that are addressed and are not a reflection 
of membership in a specific sex or ethnic category. 

The FTCE is currently administered t e times a year in selected locations 
throughout the state. Data from the first annual (1980-81) report indicate that 
the percentage of candidates who passed the entire FTCE for the November 1980, 
April 1981, and August 1981 administrations were 79%, 83%, and 80%, 
respectively. Examinees who do not pass all of the tests at one administration 
may retake the tests not passed at later scheduled testing dates. 
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APPENDIX A 



Essential Competencies and Sub ski lis 
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APPENDIX B 



Mathematical Illustrations of Formulas 
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The following formulas were used in the calculation of statistics 
for the FTCE; 



(a) Point-biserial Correlation 



m s - m M T J 



where f^y - point blserlal correlation 
coefficient 



m s m mean total score of examinees 
CT L J answering item right 

- mean total score of examinees 
answering item wrong 

CT " standard deviation of total 
score for entire group 

p m proportion of examinees getting 
item right 

1 - 1 - P 

(b) Kuder-Richardson Formula 20 Reliability Coefficient 

where X m number of items/questions (any 
omitted questions not Included) 

a — ^ — I J — ^ffiL I p - proportion of examinees getting 

X ~ 1 L <T* J itBm rl » ht 



v* 



<y 2 * variance of the total score 



(c) Standard Error of Measurement 

where 4^ » standard error of measurement 

<Tf 0 the standard deviation ot total 
scores 



s X V ' XX fjjjj - the reliability coefficient 
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(d) Item Discrimination Index 



where I?, 



u 



R, - 



T 



number of students In high score 
range (i.e., the upper 272) who 
answered the item correctly 

number of students in low score 
range (i.e., the lower 27%) who 
answered the item correctly 

total number in the upper and 
lower groups 



(e) Coefficient Alpha 



Coefficient alpha is used as an estimate of the inter-rater reliability 
of Writing test scores. This coefficient Indicates the expected correlation 
between the ratings of the team on this task and those of a hypothetical 
team of similarly comprised trained raters doing the same task. 



kk 



. -4- 

k-l L 



iter. Jjji 

k 



coefficient of reliability (alpha) 

number of test items 

sum of the variances of each Item 

variance of the examinees' total 
test score 



(f) Brennan-Kane reliability 



The Brennan-Kane Index denotes the reliability of "master" and 
"nonmaster" classifications with respect to a measure of a standard or skill. 
The formula is: 



m?c) = | - 



rii-l 



where 



number of items 

grand mean over Hp persons and 
items , 

sample variance of persons* mean 
scores over items 



that is, 55 person s 
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Security and Quality Control Procedures 
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SECURITY 



A security and quality control plan has been developed and implemented for 
the program. Components off the security plan Include: 

1. Controlled, Halted access to all examination materials; 

2. Shredding of developmental materials and used booklets; 

3. Strict accounting of all materials and of persons working with 
test items at the testing agency and test centers* 

A signed security document is obtained from every Individual who has access 
to the examination materials. The security document contains an agreement that 
the individual will not reveal — in any manner to any other individuals — the 
examination items, paraphrases of the examination items, or close approximations 
to the examination items. Only persons who have a "need to see" the items 
because of their work on the project are allowed to view any parts of the 
examination. 



Test Security During the Administration 

During the production phases of this project all typing and reproduction are 
done by persons who have security clearances. All materials are signed out when 
they are removed from locked storage and checked in when they are returned. One 
person is assigned responsibility for the secure files while all work is in 
process; this person is able to account for all materials at all times. 
Material that needs to be revised and unusable materials are not placed in 
wastebaskets but are kept in a locked file for special destruction. 

The following plan has been implemented to ensure rigorous security of all 
materials during actual examination administration. Materials remain in secure 
storage at the test centers until the morning of the test date. If multiple 
rooms are used at a center, each room is assigned blocks of materials that must 
be signed for by a room supervisor, the only person who has access to the room 
supply. Test books and materials are never left unguarded. Candidates are 
assigned seats by center personnel. The seating arrangements minimize' the 
possibility of a candidate seeing the papers of other candidates. Books are 
distributed by the room supervisor and proctors. Each booklet is handed to the 
examinees individually and the examinees sign a receipt for the booklets by 
serial number. Immediately after distribution, an inventory is taken to ensure 
that the sum of the distributed and unused books equals the number of books 
assigned to the testing room. Any discrepancy is reported to the center 
supervisor and immediate steps are taken to reconcile the discrepancy and locate 
the missing material. Every such incident is reported to the Project Manager, 
and appropriate action is Instituted to prevent further occurrences and to 
recover any missing materials. 

Candidates cannot leave the room during a test session except for an 
emergency. If a candidate must leave the room, materials are delivered to the 
room supervisor or proctor and held until the candidate's return. No materials 



aay be removed from the test room at any tine. Only one candidate nay leave the 
room at a time. Provision of a break between subtests reduces the need for 
candidates to leave during a test session. At the end of a session all test 
books are collected and accounted for before collection of the answer documents. 
After the answer documents are accounted for, all candidates in the room are 
dismissed. Upon return to their original seats, candidates are reidentified by 
test administration personnel before the distribution of materials for the next 
subtest. During breaks and the lunch period, all materials are either locked in 
secure storage or are placed under direct supervision of test administration 
personnel. All used and unused materials are returned to locked storage 
immediately after test administration. 

Quality Control 

To ensure quality control during the^ecoring and reporting process, the 
following procedures are used: 

1. Each answer document is checked for proper coding and marking in 
response areaa; 

Z. Computer edit programs are used to check for valid program codes 

on the registration forms and for matching names and social security 
numbers on the registration and scoring files; 

3. Test data are used to verify the accuracy of all scoring and reporting 
programs; 

4. Sample data are drawn prior to scoring from each administration to 
screen for key, printing, or procedural errors; 

5. Random answer documents are hand-scored during the scanning process to 
verify proper operation of the scanner; 

6. A complete review of all procedures — which includes hand-checking a 
sample of test data — is completed by members of the Office of 
Instructional Resources and the Department of Education before 
printing the candidate score reports; 

7. Analyses of the holistic scoring process are conducted. This review 
addresses the overall reliability of the ratings, the distribution of 
scores, and number of refereed scores for each reader. Specific 
procedures for quality control during the holistic scoring process are 
documented in the Procedural Manual fot Holistic Scoring; 
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The accuracy of the calculations for the institutional and state 
reports are hand- verified. 
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HOLISTIC SCORING OF THE WRITING fojBTESr 
OF THE FLORIDA TEACHER CERTIFICATION EXAMINATION 



The Writing Subtest 

The Writing subtest was designed to assess a candidate's ability to writi 
in a logical, easily understood style with appropriate grammar and sentence 
structure. The subskllls to be measured ares q 

a. Uses language at the level appropriate to the topic and reader. 

b. comprehends and applies basic mechanics of writing; spelling, 
capitalisation, and punctuation. 

c. Comprehends and applies appropriate sentence structure. 

d. Comprehends and applies basic techniques for the organisation of 

written material* 

e. Comprehends and applies standard English usage in written 

communication. * 

The candidate is given a choice between two topics on which to write an 
essay during the 45-minute examination period. This essay should demonstrate 
the competency and subskllls specified above. The essay or writing sample is 
scored hollstically by at least three trained and experienced judges. 



The Process of Holistic Scoring 

Holistic Scoring Defined 

Holistic scoring or evaluation is a process for judging the quality of 
writing samples. It has been used for many years by professional testing 
agencies for credit-by-examination, state assessment and teacher certification 
programs . 

Essays are scored hollstically, that is for the total, overall impression 
they make on the reader, rather than for an analysis of specific features of a 
piece of writing. Holistic scoring assumes the skills which make up the ability 
to write are closely interrelated and that one skill cannot be separated from 
the others. Thus, the writing is viewed as a total work in which the whole is 
something more than the sum of the parts. A reader reads a writing sample 
quickly, once. He or she obtains an impression of its overall quality and then 
assigns a numerical rating to the paper based on judgments of how well it meets 
a particular set of established standards. 

The Reader \ 

The key to effectiveness „of the holistic scoring process is the jleadetB who 
must make valid and reliable judgments. Readers must bring to the process 
experience in teaching and grading English compositions. In addition, they *ust 
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be willing to undergo training In holistic scoring which demands they set aside 
personal standards for judging the quality of a writing sample and adhere to 
standards which have been set for the examination. The goal for the reading of 
the Writing subtest of the Florida Teacher Certification Examination is to rate 
a large number of essays according to their overall competence in a consistent 
or reliable manner according to previously established standards based on a set 
of defined criteria. By undergoing e set of training procedures a group of 
experienced teachers of composition can develop a high level of consistency in 
making judgments about the quality of a group of essays. 



The Criteria 

The criteria established to score the essays for the Florida Teacher 
Certification Examination are listed below. They were developed to accommodate 
specific conditions imposed by the Writing subtest: 

(1) They reflect those characteristics widely accepted as indicative of 
good writing; 

(2) They can be translated into operational descriptions of levels of 
competence; 

(3) They reflect the general competency statement and subskills 
identified by the Council on Teacher Education. 



Specific Criteria for Evaluation of Essays 

1. Rhetorical Quality 

1.1 Unity: An ordering and interdependence of parts producing a single 
effect: completeness. 

1.2 Focus: Concent rat icn of a topic; the presence of a "center of 
gravity." 

1.3 Clarity: Lucidity of expression; lack of ambiguity and distortion. 

1.4 Sufficiency; Appropriate depth and breadth of expression to meet 
the writer's purposes and the demands of the particular topic 

2. Structural and Mechanical Quallcy 

2.1 Organization: Consistent and coherent integration and connection of 
parts. 

2.2 Development: Appropriate and sufficient, exposition of ideas; use of 
detail, examples, illustration, comparisons, etc. 

2.3 Paragraph and Sentence Structure: Appropriate form, variety, logic, 
relatedness of and among structural units. 

2.4 Syntax: Appropriate ordering of words to convey Intended meaning. 



45 



3. Observance of Conventions In Writing 

3.1 Osage: Appropriate use of language features: Inflections, tense, 
agreement, pronouns, modifiers, vocabulary, level of discourse, etc 

3.2 Spelling, Capitalization, Punctuation*. Consist-ant practice of 
accepted forms* 

The relationship between the subskills and the scoring criteria is 
Illustrated in the figure below. 



RHETORICAL 



STRUCTURAL 



CONVENTIONAL 



ESSENTIAL COMPETENCIES: 
Demonstrate the ability to 
write in a logical, easily 
understood style with 
appropriate grammar and 
sentence structure. 

a. Use language appropriate 
to the topic and reader. 

b. Apply basic mechanics of 
writing. 

c. Apply appropriate sen- 
tence structure. 

d. Apply basic techniques for 
organization. 

e. Apply standard English 
usage. 
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Operational Descriptions 

The operational descriptions based on the scoring criteria reflect the four 
levels of competency which the readers are to assign each of the essays they 
read. Each reader will independently score or rate a paper on a scale of I to 
4 with 4 being the highest rating. The descriptions which follow are an 
attempt to express clearly and precisely the general, overall imwesslons a 
reader has in terms of the criteria when he or she reads essays of varying 
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quality. The 'four levels or quality of competence could be expanded or 
decreased. However, for the task of scoring the Writing Subtest, it provides 
enough degrees of distinction to be meaningful yet manageable for large 
scale testing. 

4. The essay is unified, sharply focussed, and distinctively effective. 
It treats the topic clearly, completely, and in suitable depth and 
breadth. It is clearly and fully organized, and it develops ideas with 
consistent appropriateness and thoroughness. The essay reveals an 
unquestionably firm command of paragraph and sentence structure. 
Syntactically, it is smooth and often elegant. Usage is uniformly 
sensible, accurate, and sure. There are very few, if any, errors 
in spelling, capitalisation, and punctuation. 

3. The essay is focussed and unified, and it is clearly, if not 

distinctively, written. It gives the topic an adequate though not 
always thorough treatment. The essay is well organized, and much of 
the time it develops ideas appropriately and sufficiently. It shows a 
good grasp of paragraph and sentence structure, and its usage is 
generally accurate and sensible. Syntactically, it is clear and 
reliable. There may be a few errors In spelling, capitalization, and 
punctuation, but they are not serious. 

2. The essay has some degree of unity and focus, but each could be 

improved. It is reasonably clear, though not invariably so, and it 
treats the topic with a marginal degree of sufficiency. The essay 
reflects some concern for organization and for some development of 
ideas, but neither is necessarily consistent nor fully realised. 
The essay reveals some sense, if not full command, of paragraph and 
sentence structure. It is syntactically bland and, at times, 
awkward. Osage is generally accurate, if not consistently so. There 
are some errors in spelling, capitalization, and punctuation that 
detract from the essay's effect if not from its sense. 

1. The essay lacks unity and focus. It is distorted and/or ambiguous, 
and it fails to treat the topic in sufficient depth and breadth. 
There is little or no discernible organization and only scant 
development of ideas, if any at all. The essay betrays only 
sporadically a sense of paragraph and sentence structure, and it is 
syntactically slipshod. Usage is irregular and often questionable or 
wrong. There are serious errors In spelling, capitalization, and 
punctuation. 



Training of Readers 

The training of readers for the Writing subtest of the Florida Teachers 
Certification Examination consists of three steps! 
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Acquiring Info mat loo about the examination and holistic scoring 
process* 

Reading and scoring essays which have been selected as good examples 
of the various levels of competence in writing. The practice essays 
have been scored by experienced readers and annotated In accordance 
with the operational descriptions. By reading* scoring and 
discussing the essays, the readers practice until they consistently 
give the' same ratings to essays as the experienced readers. 

Reading and scoring a sample of the actual Writing subtests which 
have been selected and scored prior to the training session. These 
samples will serve as the standards for the scoring of the 
examination and will Include essays which represent each of the 
competency levels. As in Step 2, the emphasis will be on each reader 
to assign scores which agree with those established earlier by the 
experienced readers. This step occurs immediately before the actual 
scoring session and often is repeated during the session to Insure 
continued consistency or reliability of assigned scores or ratings. 



Setting the Standards 

Prior to Step 3 in the training, standards for the Writing subtest are 
established. The Chief Reader, who Is responsible for conducting the 
holistic scoring, and his assistants, the Assistant Chief Reader and the Table 
Leaders, select, at random, a sample of papers from the total group of essays 
written on a particular topic. These papers are read and scored independently 
by each person. Results are compared and consensus is reached for the 
identification of four papers. Each becomes a standard for one of the four 
competency levels. Additional papers are chosen to be used in Step 3 of the 
training procedures. This process is repeated for the second topic of the 
Writing subtest. 

The Scoring Session 

The scoring session begins immediately after Step 3. Readers are assigned 
to tables in groups of four or five. The number of readers and the number of 
tables are determined by the number of essays to be scored. Each table of 
readers is also assigned a Table Leader. The Table Leader's primary task is to 
continually monitor the scoring process and consult with readers as questions or 
"problem" papers arise. The Table Leader is an experienced reader who has 
helped set the standards. 

Each reader is given a set of papers to read, rate and mark the score. The 
Identity of the writer is not known to the reader. The papers range, on the 
average, from 200 to 400 words in length, and each can be read and scored 
holistically In approximately two minutes. As the scoring of a set of papers is 
completed by a reader, a clerk collects and returns the paper to an operation 
table. The scores given by the reader are covered, and the papers are 
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redistributed to another set of folders and delivered by the clerk to a second 
table of readers. This procedure continues until each paper has been read by 
three different readers. Each reader reads, judges and scores at his own pace. 
Scoring sessions are approximately three hours long, with ten minute breaks each 
hour. Usually there are two scoring sessions for each day of holistic reading. 

After a paper has been scored by three different readers, the scores are 
examined at the operations table. If one of the scores varies from any other by 
two levels or more (ex. 3-3-1), the paper Is sent to the Chief Reader or 
Assistant Chief Reader who serves as referee. This person assigns a rating 
which replaces the discrepant score. Papers whose original ratings are 1-2-3 or 
2-3-4 are refereed and scored as follows: 

Rating of 1-2-3 

(a) A referee score of 1 or 2 will replace the 3, resulting in a score 
of 4 or 5 

(b) A referee score of 2 will, replace the 1, reaulting in a score of 7 
Rating of 2-3-4 

(a) A referee score of 2 will replace the 4, resulting in a score of 7 

(b) A referee score of 4 will replace the 2, resulting in a score 
of 11 

(c) A referee score of 3 will replace the 2, resulting in a score 
of 10 

All initial scores of 5 will be refereed. If any paper is refereed and a 
discrepancy still occurs, the essay is submitted to a new team of readers until 
consistency is obtained. 

The three scores are then added together for a total score. Thus the 
lowest score possible is a 3 t the highest, 12. 

Final Steps 

After the reading sessions are completed. Table Leaders evaluate the 
performance of Readers. The Chief Reader evaluates the Table Leaders. Readers 
are asked for comments and suggestions for improving training and scoring 
procedures. 

Two approaches for reliability estimation are the percentage of rater 
agreement and the calculation of coefficient alpha for the raters yand the rating 
team, which indicates the expected correlation between the ratings of the team 
and those of a hypothetical team of similarly comprised and similarly trained 
raters doing the same task. The four indices that represent rater agreement 
are: (a) percent complete agreement; (b) average percent of two of the three 
raters agreeing; (c) average percent agreement by pairs as to pass/fall; and 
(d) percent complete agreement about pass/fail. These data are reported in 
Table 9, page 2. 
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